A new achievement for the Minecraft community, pushing the boundaries, is a large language model built within the popular game, featuring ChatGPT functionality. A YouTube channel named sammyuri has successfully implemented this AI in the Minecraft world using Redstone circuits, the game’s core automation element. The project’s name, CraftGPT, is a reference to this connection.
CraftGPT is officially here
Building complex machines and functional computers with Redstone was already possible. However, this new development raises the bar by creating an AI-based chatbot with Redstone.
The details of the CraftGPT build are quite impressive. The model is designed as a monster of Redstone and ROMs with 5,087,280 parameters. While modern language models have billions of parameters, this figure is considered groundbreaking in the blocky world of Minecraft. Even AlexNet, considered the ancestor of all AI, had 60 million parameters.
The model was trained externally using simple English conversations on the TinyChat dataset using Python. Sammyuri explained that the model’s learning process took place outside the game, but the trained model was run within Minecraft using Redstone circuits. The model has a vocabulary of 1,920 tokens.
This entire system consists of a total of 439 million blocks. Naturally, this massive machine cannot be viewed at normal viewing distance. Performance is quite limited: Even with a high-performance Redstone server, it takes the AI approximately two hours to produce a single answer.
Therefore, this project is more important as a proof of concept than a practical chatbot. Gamers have been building calculators, hard drives, and game emulators with Redstone for years, but building a neural network-level model by connecting millions of logical connections represents a completely different level of success.
{{user}} {{datetime}}
{{text}}